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“\Ne  got  nothing  until  they  slammed  into  us 


-LTC  Rock  Marcone,  BN  Commander,  69*^  Armor,  3ID 


He  was  told:  a 
single  Iraqi 
brigade  is 
approaching 


Reality:  he 
faced  THREE 


Ref:  Technology  Review,  November  2004  Issue 
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Bottom  Line  Upfront 


•  Networking  “capability”  will  remain  a  scarce 
resource  that  will  be  rationed  now  &  in  future 

*  Communication  capability  needs  to  be  modeled 
dynamically  in  all  force-on-Force  Simulators 

-  It  is  a  “Game”  -  network  capability  results  from 
interdependencies  of  actions  of  individual 
agents 

-  Metamodeling  of  network  performance,  with 
tools  like  Qualnet 

-  Impact  of  wrong  assumptions  on  key 
networking  parameters  can  be  significant 
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Bottom  Line  Upfront  (cont.) 


Results:  Force  Makeup  Matters 


Outline 


Background  and  motivation: 

-  What  is  Network  Centric  Operations  (NCO)? 

Scarcity  of  networking  capacity 

How  Can  MANA  be  used  to  assess  NCO 

Model  of  impact  of  network  performance  on  warfighter 

On-going  and  future  work 


Discussion:  fallacies  of  NCO 


What  is  Network  Centric  Operations? 


The  emerging  concept  of  networked  operations, 
referred  to  by  DOD  as  network-centric  operations 
[NCO]  invoives  deveioping  communications  and 
other  iinkaqes  among  ail  elements  of  the  force  to 
create  a  shared  awareness  of  operations. 


Layers  of  the  Infosphere 


Background  -  Lessons  Learned  Report* 


•  Pros  of  NCO  (as  seen  through  current  operations) 

-  Improvements  in  force  networks  &  use  of  precision  weapons  are 
primary  reasons  for  the  overwhelming  combat  power  in  OIF 

•  Cons  of  NCO: 

-  Large  increases  in  the  pace  of  operations  &  Volume  of 
information  have  overwhelmed  commanders  at  times 

-  Slow  or  inaccurate  [BDA]  assessments  can  negate 
improvements  in  the  speed  of  operations,  battle  damage 
assessments  didn’t  keep  up  with  the  pace  of  operations 


-  The  improved  ability  to  share  view  of  the  battlefield  and 
communicate  quickly  has  compressed  the  time  required  for 
analysis  and  decision  making 


*GAO-04-547:  “Recent  Campaigns  Benefited  from  improved  Communications  and  Technoiogy,  but  Barriers  to  Continued 
Progress  Remain” , 


Motivating  Research  Question: 
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PLATFORMS  &  SENSORS 


What  is  the  Marginai  increase  in  Warfighter 
RAND  Effectiveness  From  Networking. 


Tools:  MAN  A  Captures  At  Least  Three 
Components  of  Warfighter  Performance  of 


NCO 


Cognitive 

Capability 


Sensing 

Capability 


“Communication 

capability 


99 


Performance  Components: 

*  Sense/acquire  data  (sensors) 

*  Disseminate  and  communicate  data  (networks) 

*  Interpret,  fuse,  react  to  the  data  (cognition) 
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Networking  Capability  Is  A  Dynamically 
Changing,  Scarce  Resource 
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Demand  for  Networking  Capability  Wiii 
Continue  To  Outpace  Suppiy 


Bandwidth  Demand  Continues  to  Grow 
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Kosovo  Afghanistan 

(2000)  (2002) 

Operation 


Operation  Iraqi 
Freedom  (2003) 
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Type  of  Data  Message  Matters:  Future  Force 
Requirements  Exceed  Current  Availability 


Initial  Estimates  Suggest  Future  Requirements  (Demand) 
Will  Exceed  Existing  Supply 


IWN[>MG156-f.7 
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Can’t  “train  as  we  fight” 


Wireless  Capacity  Doesn’t  Scale:  The  More 
Users,  The  Less  Capacity  Per  User 

Capacity  of  a  (Random  Access)  Network  Decreases  with  Size 
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Directional  Antennas  and  Spectrum 
Improve  Scalability  of  Wireless  networks 


Capacity  of  a  (Random  Access)  Network  Decreases  with  Size 
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RAND  MG1 56-1.4 


Capacity  Comes  From  Spectrum,  “Good 

Spectrum”  is  Scarce 
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Bottom-Line:  Avoid  Assuming  Uniimited 
“Messaging”...  Especiaiiy  in  Urban  Ops 


How  Can  MAN  A  Be  Used  to  Assess 
Network  Centric  Operations 

(Or  at  ieast  account  for  scarcity 
of  networking  capabiiity) 


RAND 


MAN  A  Captures  At  Least  Three 
Components  of  Warfighter  Effectiveness  of 

NCO 


Sensing  Factors: 

Sensing 

Sensing 

Capability 


Comm  Factors: 

Capacity 

Latency 

Reliability 


Communication  ” 
capability 
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A  MANA  Scenario  Was  Examined 


•Blue  Forces  (7) 

•Two  squads 

•Indirect 
Sqd  (1) 

•Infry  Sqd 

(6) 

Red  Forces  (100) 


Red 

Tendency 


Blue  Goal 
RAND 


Basic  Scenario:  One  Link  Between  infry  Squad 
(Sensors)  and  “indirect  Fire  Unit” 


msgs 
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Thousands  of  MAN  A  Experiments  Result  in 
Translation  of  Factors  into  Effectiveness 


Factors: 

•Capacity 

•Reliability  ” 

•Latency 

•Accuracy 

•Situation 
Handling 
(Target  Rate) 

•Sensing 

RAND 


Output: 

•  Warfighter 
Effectiveness 
LER 


Goal? 


"DATA  FARMING  EXERCISE" 


Statistical  Analysis  of  Results  Produced  a 

Model 


10  20 


LER  Predicted  P<.0001  RSq=0.90 
RMSE=1.1546 


LER=  -72.62-0.4839*Capacity-2.0485*Latency-0.00667*{Capacity- 

56.31 58)*(Latency-0.94737)  +  0.0369*Accuracy-0.00412(Latency- 

0.94737)*(Accuracy-75)+0.000699*TargetRate- 

0.0051 3*(Latency0.94737)*(TargetRate-1 25)  + 

0.0672*Sensing0.000842*(Capacity56.3158)*(Sensing-62.5)- 

0.0241*(Latency-0.94737)*(Sensing-62.5)+0.000358*(Accuracy- 

75)*(Sensing-62.5)+0.000104*{TargetRate-125)*(Sensing-62.5) 

+26.802*Ln(Capacity)  +0.1 97*{Capacity-56.31 58)*(Ln(Capacity)- 

3.87424)+1.55{Latency-0.94737)*(Ln(Capacity)-3.87424)- 

0.0189*(Accuracy-75)*{Ln{Capacity)-3.87424)+0.0751*(Sensing- 

62.5)*(Ln(Capacity)-3.87424) 


Plot  of  Actual  Results  vs.  Modeled  Result  Is  “Good 
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*  Case:  Dynamic  reliability  Incorporated 


LER  -  (Loss  Exchange  Ratio) 


Result  From  Model:  Capacity  Improves  Warfighter 

Effectiveness  to  a  Point 


R 

*  Case:  Static  reliability  Incorporated 
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Examination  of  Three  Individuai  Runs:  Capacity 


0  100  200  300  400  500  600  700  800 
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Time  in  Simulation 


LER 


Statistical  Analysis  of  Results  Produced  a 

Model  (cont) 


22.5 

17.48341 

5.0093 


Latency  Accuracy  TargetRate  Sensing  Ln(Capacity)+Capacity 


t  t  I 

Intuitive  Results:  Better  Sensing,  More  Capacity, 
Lower  Latency  Improved  Loss  Ratio 
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Reliability 


New  Experiments:  MANA  Was  Made  to 
Calculate  Reliability  Dynamically 


Reliability  Decreases  as  the  Ratio  of  #  Messages-to- 

Capacity  Increases 


y  =  -4.456x"  -  0.8749x  +  1 .0145 


MetaModel  of  Communication  Performance 

Deveioped  Using  Quainet 


Parameters 

(Tech. 

Options) 

•Traffic  volume  &  type 
•Terrain  type 
•Number  of  Nodes 
•Node  mobility 
•Other  factors 


Quainet  Simulations 


Performance  Data 


Warfighter 

Effectiveness 

e.g.,  mission 
execution, 
attrition,  etc. 
RAND 


Force  on  Force 
Simulations 
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Model  Synthesized 


%  Network  loading, 
other  parameters 


A  Different  Scenario  Deveioped  at  PAiW 

Workshop 


Variant  1:  Direct  Fire  Fight  Variant  2:  Indirect  Fire  Support 


•  Blue  goal:  secure  perimeter  &  keep  Red  out  of  mosque 


*  Blue  uses  situational  awareness  from  UAV  sensors 

*  Question:  how  criticai  is  networking  performance  to  Biue 

RAND 


In(ler) 


Result  From  “Data  Farming”  On  Variant  #1: 
Blue  Outcome  Not  Helped  By  Networking  By 

One  Measure  (LR) 


1.  Not  all  networking  capability  factors  improved  the 
outcome 

2.  Increased  networking  capability  made  outcome 
slightly  worse  in  terms  of  loss  ratio  (LR) 

3.  Neither  did  increased  manpower  in  terms  of  loss  ratio 
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Summary  of  Simulation  Results  From  Variant  1 
Based  on  Two  Outcome  Measures 


“Direct  Fire”  Variant 


6-man 

9-man 

12-man 

Mean  LER 

1.64 

1.67 

1.76 

Max  LER 

3.75 

3.83 

4.18 

Min  LER 

0.7 

0.66 

0.78 

Mean  Red  Kills 

7.2 

10.39 

13.4 

Recap:  Scenario 
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Retrospect:  Did  Variant  #1  Reaiiy  Suggest  That 
Networking  Hurt  The  Warfighter? 


6-man 

9-man 

12-man 

Mean  LER 

1.64 

1.67 

1.76 

Max  LER 

3.75 

3.83 

4.18 

Min  LER 

0.7 

0.66 

0.78 

Mean  Red  Kills 

7.2 

10.39 

13.4 

Likelihood  Blue 
Objective  Achieved 

10% 

17% 

28% 

Repeated 
Anaiysis 
With  New 
Metric 


Unciear:  Perhaps  we  chose  the  wrong 

performance  measure 


Probability  of  Success  (p) 


Resulting  Model:  Reliable  Communication  of  Accurate 
Information  is  Needed  to  Increase  Odds  of  Success 


Accurate  Reporting  of  High  Vaiue  Target  Locations  Combined 
with  Good  Comms  Can  Boost  Mission  Success  Rates 


'Excellent'  Comir 
'Average'  Commi 
'Poor'  Comms 


Case:  variant  1 
No  Indirect  Fire 
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Summary  of  Simulation  Results  From 
Enhanced  Force  makeup  (Variant  2) 


“Indirect  Fire”  Variant 


6-man 

9-man 

12-man 

Mean  LER 

1.92 

1.19 

1.19 

Max  LER 

5.72 

3.65 

4.13 

Min  LER 

0.65 

0.52 

0.48 

Mean  Red  Kills 

15.99 

17.52 

17.58 

Likelihood  Blue  Objective 
Achieved 

34% 

39% 

38% 

Recap:  Scenario 
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Direct  Fire  Oni^ 


indirect  Fire 
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Result  From  “Data  Farming”  With  Enhanced 
Force  (Variant  #2):  Blue  Does  Weil ! 


RangerSensing  UAVSensing  Accuracy  Latency  IFRange  In(capacity) 


1.  Networking  capability  factors  do  improve  the  outcome 

2.  Increased  networking  capability  made  things  better 

3.  Good  results  not  dependent  on  manpower 


Apparently  Force  Makeup  Matters  More  Than 
RAND  Networking  Performance 


Probability  of  Success  (p) 


Results:  Accuracy  Helps, 

More  Appropriate  Force  Helps  Most 


Accurate  Assessment  of  High  Value  Targets  Improves 
Probability  of  Mission  Success 


50  55  60 
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Conclusions  From  MAN  A  Analysis  of  Several 

Different  Scenarios 

*  Force  makeup  matters:  the  impact  of  information  on 
warfighter  can  be  iarge  but  very  much  scenario/force- 
structure  dependent  -  and  more  isn’t  aiways  better 

*  Communication/networking  capabiiity  needs  to  be  modeied 
Dynamically  in  Aii  Force-on-Force  Simuiators 

-  it  is  a  “Game”  -  network  capabiiity  resuits  from 
interdependencies  of  actions  of  individuai  agents 

-  Metamodeiing  of  network  performance  is  possibie  with 
Toois  iike  Quainet 

-  impact  of  wrong  assumptions  on  communications 
capabiiity  couid  be  significant 

*  Anaiysis  methods:  the  costs  of  networking  and 
communication  capabiiity  must  aiways  be  incorporated  (not 
just  benefits) 

RAND 


Bottom-Line:  Force  Structure  Matters 


Figure  22:  Situations  Where  Networking  Capability  Is  An  Effectiveness  Multiplier 
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Motivating  Research  Question: 


What  is  the  Marginai  increase  in  Warfighter 
RAND  Effectiveness  From  Networking. 


Next :  Direct  Integration  of  Network 
Simulator  and  Force-on-Force  Simulator 


MANA 
Agent-based 
model  used  by  G-8 


Node  status  (alive?)  Msg  status  (received?) 


Qualnet 


Scalable; 
designed  to 
run  on  parallel 
machines 
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On-going  Work:  Tie  in  Network  Simuiation  to 
Force  on  Force:  MANA  and  Quainet 


Window  [Explorer  [J] 


^Animator  Window  [new[run_l][Interactive,  Canned]] 


Layer  animations 
Animation  commands  -w 


!§)  Output  Window  [new[run_l]  -  I/O] 


Partition  0,  Node  97  (44.00,  132.00,  0.00). 
Partition  0,  Node  98  (121.00,  46.00,  0.00). 
Partition  0,  Node  99  (167.00,  99.00,  0.00). 
Partition  0,  Node  100  (187.00,  95.00,  0.00). 

Initialization  completed  in  1.0170  sec 


Current  Sim  Time[s] 
Current  Sim  Time[s] 
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Real  Time[3] 
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Figure  6: 
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On-going  Work:  Tie  in  Network  Simuiation  to 
Force  on  Force:  MANA  and  Quainet 
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Figure  1:  The  External  Interface  Design  in  Quainet  (Quainet  Programmers  Guide) 
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MANA 


MAN  A  -  A  Convenient  Tool  For  Investigations 


•  A  need  to  quantify  the  marginal  impact  of 
networking  on  warfighters 

*  Developing  a  tool  that  allows  us  to  quickly  and 
efficiently  model  how  signal  attenuation  is  affected 
by  the  environment,  transmission  frequency, 
network  architecture,  protocols,  and  spatial 
orientation 
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Objective  Success 


Reliable  communication  of  accurate  Information  is 
needed  to  Increase  odds  of  success 


o.s 

0.09S017 

0 


Capacity  RangerSensing  UAVSensing  Accuracy  Latency 
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On-Going  Work: 


RAND  is  Utiiizing  Mitre-Deveioped* 
Joint  Urban  Scenario  Designed  for  MAN  A 

Continuation  of  This  Effort 
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*G-8  Involved  in  Scenario  Developed 
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Appendix 


Discussion:  Faiiacies  of  NCO 
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Cebrowski  Illustration  of  NCO 


INFOGRID 


RAND  MG  155- 1. 1 

SOURCE:  Cebrowski  and  Garstka  (1998). 
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Motivating  Questions:  is  This  Siide  True? 
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Oniy  True  if  You  Buy  into  Reed’s  Accounting 

of  Network  Vaiue 


Observations 


Analysis  Needs:  Incorporate  the  Costs 
of  Networking  and  Communication 

•  Not  Just  benefit  of 
Messaging/Networking 
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Full  Factorial  Experimental  Design 


300  scenarios  x  50  runs  each  =  15,000  runs 
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Preliminary  Conclusions 


•  Warfighter  effectiveness  was  affected  by  capacity 

-  Could  be  cut  in  half  w/o  sufficient  capacity 

*  Capacity  comes  from  frequency  spectrum 
allocation 

*  Latency  (Delay)  Affected  Warfighter  Effectiveness 
by  as  Much  as  50%  for  a  Given  Capacity 
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Analysis  Via  T-Ratio  Says  Almost  Ail 

Terms  in  Model  Useful 


Term 

Std  Error 

T-ratio 

Prob  >  |t| 

Intercept 

4.46784 

0.81013 

5.514968 

0.00000 

Reliability 

1.850291 

0.070591 

26.21126 

0.00000 

Capacity 

-11.491 

2.854192 

-4.026 

0.00007 

(Reliability-50)*(Capacity-1 0) 

-1.36919 

0.307317 

-4.45532 

0.00001 

Latency 

-0.40872 

0.061134 

-6.68568 

0.00000 

(Reliability-50)*(Latency-2) 

-0.44439 

0.086456 

-5.14002 

0.00000 

(Capacity-1 0)*(Latency-2) 

0.29615 

0.266144 

1.112743 

0.26676 

Accuracy 

0.364199 

0.049916 

7.296285 

0.00000 

(Reliability-50)*(Accuracy-75) 

0.133963 

0.070591 

1.897718 

0.05875 

(Capacity-1 0)*(Accuracy-75) 

-0.17904 

0.217306 

-0.82391 

0.41068 

(Latency-2)*(Accuracy-75) 

-0.22162 

0.061134 

-3.62522 

0.00034 

ln(Capacity+2) 

14.4745 

3.336282 

4.338513 

0.00002 

(Reliability-50)*(ln(Capacity+2)-2. 20964) 

2.441513 

0.306588 

7.963497 

0.00000 

(Capacity-1 0)*(ln(Capacity+2)-2. 20964) 

5.593925 

1.705863 

3.279235 

0.00117 

(Latency-2)*(ln(Capacity+2)-2. 20964) 

-0.50641 

0.265513 

-1.90728 

0.05749 

(Accuracy-75)*(ln(Capacity+2)-2. 20964) 

0.380287 

0.21679 

1.754167 

0.08048 

Clearly:  Reliability,  Capacity,  Latency, 
Accuracy  and  2-way  Interactions  Important 
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LER 


Statistical  Analysis  of  Results 


Initial  Analysis  of  Exact  Models  Says  Capacity  Is  Major  Factor 


MAN  A  Incorporates  A  Number  of  Communication  Factors 

For  Each  Link 


•  Reliability  -  Likelihood  that  a  given  message  will  be  successfully  sent  on 
link  per  try.  Attempts  will  be  made  at  resending  unsuccessful  messages  until 
they  are  successfully  communicated.  (0%-100%) 

•  Capacity  -  “Number  of  messages  that  can  be  sent  through  the  link  per 
time  step.” 

•  Latency-  Number  of  time  steps  taken  for  each  message  to  reach  the 
receiving  squad.” 

•  Accuracy  -  This  parameter  sets  the  probability  that  a  contact’s  type  will 
be  passed  correctly.  When  a  link  is  acting  inaccurately  an  incorrect  type  out 
of  the  pool  of  enemy,  friend,  neutral  and  unknown  contact  types  is  sent  for 
the  contact.  An  accuracy  of  0%  means  always  send  as  incorrect  contact  type 
and  100%  means  always  send  as  correct  contact  type.  The  accuracy 
parameter  is  particularly  useful  for  friendly  fire  type  studies.  (0%-100%)” 
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Communications  Link  Variabies 


VARIABLES 

'Reliability  (0-100)% 
•Capacity  (0-20) 
•Latency  (0-4) 
•Accuracy  (50-100)% 
•Sqd  3  Ammunition 
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Why  a  Meta-Model? 


1 .  Communication  network  simuiation  is 
compiex  and  time  consuming 

2.  Meta-modeis  aiiow  fiexibiiity  whiie  not  adding 
iarge  overhead  time  to  combat  simuiations 

3.  Regression  analysis  can  be  used  to  generate  a 
model  “off-line” 
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Relevant  Studies  Using  MAN  A 


•  Ipecki  and  Lucas,  2002,  Naval  Post  Graduate  School 

-  “Agent-Based  Models  Utilized  to  Explore 
Intangibles  Inherent  in  Guerilia  Warfare” 


MAl^A  -  infStrationl 
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l~  Show  Flags 


Steps 


800 
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Infiltration  scenario 

Mission:  Blue  Tank  Pit 
interdict  Red  from 
hilltop  postion 

Blue:  2  Tanks,  2  ACVs 
11  infr 

Red:  11  Infry  w/ 
light  weapons 
(1  recon  team, 

2  infiltration  teams) 


Relevant  Studies  Using  MAN  A  (cont.) 


*  Ipecki  and  Lucas,  2002,  Naval  Post  Graduate  School 

-  “Agent-Based  Models  Utilized  to  Explore  Intangibles  Inherent 
in  Guerilla  Warfare” 

-  Study  Conclusions: 

•  Results  are  mostly  affected  by  factors  associated  with 
Red  -  Stealth  ability  important 

•  More  cohesive  guerilla  forces  who  do  not  stay  with 
injured  and  form  big  groups  to  better  at  infiltration 

•  Red  side  negated  blue  fire  power  by  increasing  sizes  of 
infiltration  teams 


RAND 


Relevant  Studies  Using  MAN  A  (cont.) 


Anthony  Dekker,  2004 

Defence  Science  and  Technology  Organisation 
“Simulating  Network  Robustness” _ 


r 

© 

1 

Conclusions:  Best  Predictor  of  Combat 
Outcome  -  ’’Intelligence  Quotient” 

The  intelligence  coefficient  /  is  obtained  by  summing  (over  all  combat  nodes  and  all  relevant 
sensors  for  that  node)  the  quotient  of  sensor  quality  and  total  path  delay,  where  is  the  total 
path  delay  from  sensor  node  i  to  combat  node  j  (or  oo  if  there  is  no  connection),  and  q.  is  the 
quality  of  sensor  i.  Essentially  the  intelligence  coefficient  measures  the  ability  of  the  network  to 
effectively  move  sensor  information  to  the  point  where  it  is  needed. 
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Adjusted  LER  «  1.6  ^  I^(l/4)  (1.043)^ 


UAVs  Provide  Additional  Connectivity 

UAVs  Add  Connectivity  and  Capacity  But  Could  Require 
Large  Numbers  of  Vehicles 


Number  of  UAVs 

RAND/HeT5«.4 
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Network  Manager  Options 


RAND 


MANA  -  An  Agent-Based  Force  on  Force 

Simulator 


RAND  owns  source  code  and 
collaborates  with  NZ  Defense 
Technology  Agency  on 
modifications 

RAND  Modified  it  to  factor 
dynamics  of  networking  -  no 
static  assumptions 

RAND  modified  it  to  be 
integrated  with  Qualnet 
network  simulator 

Used  in  a  number  of  studies 
abroad  and  in  academic 
settings  (NPS)  for  analysis  - 
runs  very  fast 
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MAN  A  Captures  At  Least  Three 
Components  of  Warfighter  Effectiveness  of 

NCO 


Sensing  Factors: 

Sensing 

Sensing 

Capability 


Comm  Factors: 

Capacity 

Latency 

Reliability 


Communication  ” 
capability 
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Modeling  and  Simulation  for  Urban  Scenario 

To  Examine  NOW  Hypotheses 


Variant  1:  Direct  Fire  Fight  Variant  2:  Indirect  Fire  Support 


•  Blue  goal:  secure  perimeter  &  keep  Red  out  of  mosque 


*  Blue  uses  situational  awareness  from  UAV  Sensors 

*  Question:  How  critical  is  networking  performance  to  Blue 

RAND 


Probability  of  Success  (p) 


Results:  Reliable  Communication  of  Accurate 
Information  is  Needed  to  increase  Odds  of  Success 


Accurate  Reporting  of  High  Vaiue  Target  Locations  Combined 
with  Good  Comms  Can  Boost  Mission  Success  Rates 


'Excellent'  Comir 
'Average'  Commi 
'Poor'  Comms 


Case:  variant  1 
No  Indirect  Fire 


0 
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Results:  Accuracy  Helps, 

More  Appropriate  Force  Helps  Most 


Accurate  Assessment  of  High  Value  Targets  Improves 
Probability  of  Mission  Success 
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Conclusions  From  MAN  A  Analysis  of  Several 

Different  Scenarios 

*  Force  makeup  matters:  the  impact  of  information  on 
warfighter  can  be  iarge  but  very  much  scenario/force- 
structure  dependent  -  and  more  isn’t  aiways  better 

*  Communication/networking  capabiiity  needs  to  be  modeied 
Dynamically  in  Aii  Force-on-Force  Simuiators 

-  it  is  a  “Game”  -  network  capabiiity  resuits  from 
interdependencies  of  actions  of  individuai  agents 

-  Metamodeiing  of  network  performance  is  possibie  with 
Toois  iike  Quainet 

-  impact  of  wrong  assumptions  on  communications 
capabiiity  couid  be  significant 

*  Anaiysis  methods:  the  costs  of  networking  and 
communication  capabiiity  must  aiways  be  incorporated  (not 
just  benefits) 
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Best  Solution:  Direct  Integration  of  Network 
Simulator  and  Force-on-Force  Simulator 
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Scalable; 
designed  to 
run  on  parallel 
machines 
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Resulting  New  Capabilities:  Direct  Integration 
of  Network  Simulator  and  Force-on-Force 

Simulator 
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Node  status  (alive?) 


Lessons  Learned  from  Direct  Integration 

of  Tools  (so  far) 

-  static  assumptions  of  networking  capability 
can  result  in  overly  optimistic  analysis 

-  Example  to  follow 
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effectiveness 


Conclusions  (Cont) 


Results:  Force  Makeup  Matters 


A  Full  Factorial  Set  of  Experiments 


Capacity 

Latency 

Accuracy 

Situation 

Handiing 

Sensing 

Min 

20 

0 

50% 

50% 

25 

Max 

100 

2 

100% 

200% 

100 

Interval 

20 

1 

25% 

50% 

25 

Table  1 :  A  Full  Factorial  Set  of  Experiments 

•720  scenarios  x  50  runs  each  =  36,000  runs 

•Script,  caiied  RANDex  ©,  executes  command  iine  MANA  runs 
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A  Good  Fit  For 
MetaModel  Achieved 
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Warfighter  Effectivenss  = 
f(sensing,  communication,  cognitive) 


10 


20 


LER  Predicted  P<.0001  RSq=0.90 
RMSE=1.1546 


LER=  -72.62-0.4839*Capacity-2.0485*Latency-0.00667*(Capacity-56.3158)*(Latency- 
0.94737)  +  0.0369*Accuracy-0.00412(Latency-0.94737)*(Accuracy-75)+ 
0.000699*TargetRate-0.00513*(Latency0.94737)*(TargetRate125)  + 
0.0672*Sensing0.000842*(Capacity56.3158)*(Sensing-62.5)-0.0241*(Latency- 
0.94737)*(Sensing-62.5)+0.000358*(Accuracy-75)*(Sensing- 
62.5)+0.000104*(TargetRate-125)*(Sensing-62.5)  +26.802*Ln(Capacity) 
+0.197*(Capacity-56.3158)*(Ln(Capacity)-3.87424)+1.55(Latency- 
[  0.94737)*(Ln(Capacity)-3.87424)-0.0189*(Accuracy-75)*(Ln(Capacity)- 
3.87424)+0.0751*(Sensing-62.5)*(Ln(Capacity)-3.87424) 
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Impact  of  Cognitive  Factors 
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Profiles:  The  Marginal  Impact  of  Individual 

Factors 
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